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Abstract 

More than three million people in Nigeria are living with HIV/AIDS. In order to reduce the HIV/AIDS burden in 
Nigeria, the US Government (USG) has dedicated significant resources to combating the epidemic through the 
President's Emergency Plan for AIDS Relief (PEPFAR). In-service training (1ST) of health workers is one of the most 
commonly used strategies to improve the quality and coverage of HIV/AIDS services. At USAID/Nigeria's request, 
the USAIDTunded CapacityP/i/s project conducted an assessment of PEPFAR-funded 1ST for all cadres of health 
workers in Nigeria. Using the 1ST Improvement Framework, developed by the USAID Applying Sciences to 
Strengthen and Improve Systems Project (ASSIST), as a guide, the authors developed a survey tool to assess the 
efficiency, effectiveness and sustainability of 1ST provided between January 2007 and July 2012 by PEPFAR-funded 
implementing partners in Nigeria. The instrument was adapted to the Nigerian context and refined through a 
stakeholder engagement process. It was then distributed via an online platform to more than 50 PEPFAR-funded 
implementing partners who provided 1ST in Nigeria. A total of 39 implementing partners completed the survey. Our 
survey found that PEPFAR implementing partners have been providing a wide range of 1ST to a diverse group of 
health workers in Nigeria since 2007. Most trainings are developed using national curricula, manuals and/or other 
standard operating procedures. Many of the partners are conducting Training Needs Assessments to inform the 
planning, design and development of their training programs. However, the assessment also pointed to a number 
of recommendations to increase the efficiency, effectiveness and sustainability of PEPFAR-funded 1ST. These actions 
are as follows: improve collaboration and coordination among implementing partners; apply a more diverse and 
cost-effective set of training modalities; allocate funding specifically for the evaluation of the effectiveness of 
training; improve links between 1ST and both continuing professional development and pre-service education; 
require implementing partners to create sustainability plans to transition training from PEPFAR funding to other 
funding sources; and develop a training information management system to track key aspects of 1ST, such as the 
number and types of providers, courses, and participants of PEPFAR-funded 1ST. 
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Background 

Nigeria has a population of over 162 million, which is by 
far the largest number of inhabitants among African 
countries [1,2]. HIV prevalence among adults in Nigeria 
is approximately 4.1% [3]. In total, Nigeria has an esti- 
mated 3.1 million people living with HIV/ AIDS, which 
accounts for 10% of the global HIV burden [4]. Though 
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HIV prevalence is decreasing, the number of people re- 
quiring antiretroviral therapy is on the rise, up from 
around 850,000 in 2008, to over 1.45 million in 2011 [5]. 
Health system challenges, including health worker short- 
ages, threaten the progress the Government of Nigeria 
and development partners have made in combating HIV 
and AIDS. A sizable number of infected individuals do 
not get the treatment they need, including the 95% of 
HIV-positive pregnant women who do not receive pre- 
vention of mother-to-child transmission (PMTCT) ser- 
vices, the 73,000 children born infected annually, and 
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the 750,000 individuals in need of antiretroviral therapy 
who do not receive it [6]. Further, the largest contributor 
to the global mother-to-child transmission of HIV bur- 
den is Nigeria [7]. 

The United States Government (USG) has dedicated 
significant resources in Nigeria to combating the HIV/ 
AIDS epidemic through the Presidents Emergency Plan 
for AIDS Relief (PEPFAR). PEPFAR is managed at the 
country level in Nigeria through the United States Agency 
for International Development (USAID), the Centers for 
Disease Control and Prevention, the Department of 
Defense, and the US Embassy. The majority of PEPFAR 
activities are conducted through national-level imple- 
menting partners that include international nongovern- 
mental organizations and local government agencies 
[6,8]. Since 2004, PEPFAR has invested more than US 
$2.5 billion to reduce the HIV/ AIDS burden in Nigeria 
[9]. As a result, the number of sites providing antiretro- 
viral therapy has increased from 24 in 2005 to nearly 400 
in 2011, and PEPFAR is currently supporting nearly 
1,000 HIV counseling and testing sites in Nigeria [3]. Fur- 
ther, in 2011, PEPFAR reported supporting in Nigeria 
more than 441,000 individuals on antiretroviral therapy, 
more than 2.3 million people receiving counseling and 
testing, and more than 34,000 HIV-positive pregnant 
women receiving antiretroviral prophylaxis through 
PMTCT services [10]. 

A sufficient and qualified health workforce, supported 
by appropriate training and adequate commodities, is es- 
sential for comprehensive HIV/ AIDS prevention, care, 
and treatment. Nigeria, however, is among the 57 coun- 
tries identified by the World Health Organization as 
having a human resources for health (HRH) crisis due to 
insufficient numbers of health providers. Major HRH 
challenges affecting Nigeria include: shortages of health 
workers - especially in the north, excess health worker 
attrition, staff recruitment challenges, poor skills and 
skills mix among the different cadres of workers, dis- 
crepancies in salaries and other conditions of service 
among states, and a misalignment between pre-service 
production and training programmes and health prior- 
ities [11]. Given the HRH challenges and the urgent 
need to provide HIV/ AIDS prevention, care, and treat- 
ment services, more health workers must be educated, 
trained, and deployed to deliver these services. PEPFAR 
has worked to harmonize 1ST for health workers deliver- 
ing HIV/ AIDS services by developing a cadre of master 
trainers and standardizing training materials [12]. This 
training is crucial for updating and improving providers' 
skills and competencies and represents a large propor- 
tion of investments by the Federal Ministry of Health 
(MOH) and international development partners [6]. 

In line with PEPFAR priorities for increased ownership 
and sustainability of 1ST practices and country systems. 



more information is needed about how implementing 
partners collaborate with each other in the management 
and delivery of HIV/ AIDS related 1ST and to what extent 
training is effective, efficient, sustainable, and aligned with 
national priorities. For this reason, USAID /Nigeria re- 
quested USAID s global CapacityP/ws project to lead a 
comprehensive effort to assess the implementation of 1ST 
by PEPFAR-funded implementing partners with a view to 
identifying strengths and weaknesses in the implementa- 
tion of 1ST to inform future programming. 

For the purposes of this study, 1ST was defined as any 
PEPFAR-funded HIV/ AIDS related training that imple- 
menting partners provide for any individual health 
worker who is engaged in HIV/ AIDS related service 
provision inside or outside of their organization to de- 
velop the individuals skills. This definition of 1ST is in- 
clusive of all health worker cadres. 

Methods 

The assessment aimed to produce a comprehensive ana- 
lysis of PEPFAR-funded 1ST in Nigeria, targeted at dif- 
ferent cadres of health workers providing HIV/ AIDS 
services at all levels of the health care system and across 
a wide range of content areas. 

The 1ST Improvement Framework, developed by the 
Applying Sciences to Strengthen and Improve Systems 
Project (ASSIST), provided the foundation for develop- 
ing a survey tool (Additional file 1). The framework was 
developed through a four-round modified Delphi ap- 
proach involving a 25-member consensus group com- 
prised of key stakeholder groups and experts, followed 
by one round of external validation undertaken by 89 in- 
dividuals representing 26 countries. Stakeholder groups 
included professional bodies, education and training 
experts. Ministries of Health, nongovernmental organi- 
zations, donors, technical agencies and implementing 
partners. A targeted literature review summarized evi- 
dence for the recommended practices and strategies. 
The final framework includes 40 recommendations for 
improving the effectiveness, efficiency, and sustainability 
of 1ST, which are grouped into six broad themes: 
strengthening training institutions and systems; coordin- 
ation of training; continuum of learning from pre-service 
to in-service; design and delivery of training; support 
for learning; and evaluation and improvement of training 
[13]. 

A modified version of the stakeholder engagement 
approach developed by the USAID-funded MEASURE 
Evaluation project [14] was followed to collect stakeholder 
feedback on a draft survey tool (Additional file 1). The 
process developed by MEASURE Evaluation was devel- 
oped based on work addressing health care and popula- 
tion planning in Africa, Asia, and the Caribbean. The 
process, as described by MEASURE Evaluation, is not 
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rigid but instead is flexible and offers guidance for en- 
gaging stakeholders. Four of the seven steps were used to 
guide the current project. First, CapacityP/ws, in collabor- 
ation with US AID /Nigeria, identified stakeholder engage- 
ment as an important part of the strategy to assess 1ST. 
Next, CapacityP/M5 developed a list of stakeholders who 
are impacted by 1ST. The list included primary stake- 
holders (for example, implementing partners, trainees) as 
well as secondary stakeholders (for example, implement- 
ing agencies, relevant government authorities). During 
the third step, CapacityP/r/5 and USAID/Nigeria agreed - 
due to time constraints as well as the focus on collabor- 
ation, overlaps in-service provision, and duplications of 
effort among implementing partners - to focus on en- 
gaging key stakeholders who can significantly influence 
the process, including implementing partners, develop- 
ment partners, the MOH, and professional councils. 
Finally, CapacityP/r/5 worked to create a stakeholder en- 
gagement plan that included meetings with stakeholders 
in Abuja to provide input into the design of the online 
assessment tool. 

Stakeholders were consulted to identify key issues and 
challenges, and the most locally-relevant recommendations 
from the 1ST Improvement Framework and ensure they 
were accurately captured in the survey tool (Additional 
file 1). Key stakeholders included in the process were 
representatives from 12 PEPFAR- funded implementing 
partners, three professional councils, four development 
partners, the human resources for health division of the 
FMOH, and the National Agency for the Control of AIDS 
(NACA). 

The final survey tool (see attached) included ten gen- 
eral background questions as well as a set of 52 topic- 
specific questions for each of the following content 
areas: 

• Prevention of Mother to Child Transmission of HIV 
(PMTCT) 

• Male circumcision 

• Behavior change 

• Counseling and testing 

• Infant feeding/nutrition 

• Pediatric HIV/ AIDS 

• Care and treatment 

• Orphans and vulnerable children (OVC) 

• Laboratory /blood safety 

• Supply chain management 

• HIV and family planning 

• HIV and tuberculosis 

• Strategic information (including health information 
systems, monitoring and evaluation, and 
surveillance) 

• Leadership, policy, financing, or other systems 
strengthening 



In July 2012, the USAID Mission in Nigeria sent an in- 
vitation by e-mail to 54 PEPFAR-funded implementing 
partners in Nigeria, requesting them to participate in the 
survey delivered via an online platform. Participants 
were instructed to access the survey platform by clicking 
a web link in the invitation e-mail. Because the informa- 
tion requested in the survey required referencing many 
different sources of data and information, the survey 
was designed so that an incomplete version of responses 
could be saved and reopened at a later time, and partici- 
pants were given several weeks to complete the online 
survey. Three reminder e-mails were sent out to encour- 
age implementing partners to complete the survey. Sur- 
vey responses were accepted through November of 2012. 

Due to technical difficulties with the online platform 
(for example, due to problems with Internet connectivity 
and disruptions to the system caused by software up- 
grades), several implementing partners who completed the 
survey online were not asked all of the survey questions. 
In addition, two implementing partners, after experiencing 
considerable technical difficulties, opted to complete a 
paper-based version of the survey. In order to ensure the 
data were of high quality, the authors met with all im- 
plementing partners whose surveys were incomplete, 
contained conflicting responses, or were missing data. In- 
dividual meetings were held with 21 implementing part- 
ners to address technical issues, gather missing data, and 
validate responses. In addition, interviews were conducted 
with eight implementing partners who had not begun the 
online survey to help them complete the survey. 

Results 

A total of 39 PEPFAR-fiinded implementing partners 
completed the full 1ST survey. It is noted that 15 PEPFAR- 
funded implementing partners did not respond. Therefore, 
the results of the study may not be generalizable to all 
PEPFAR-funded 1ST in Nigeria. 

Responses to the survey were analysed according to 
the following themes: 

• Types of courses offered and health workers trained 

• Collaboration and coordination between 
implementing partners 

• Variety and appropriateness of curricula and training 
approaches used 

• Application of needs assessments and training 
evaluations 

• Integration of 1ST content into pre-service education 
(PSE) and continuous professional development 
programmes 

• Planning for the continued financial support and 
capacity for 1ST programmes 

• Use of information systems to collect and manage 
1ST data 
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Types of courses offered and health workers trained 

The number of respondents who reported offering any 
one training course between January 2007 and July 2012 
ranged from one implementing partner providing HIV 
and family planning and Internal Review Board (IRB) 
courses to 14 providing counseling and testing and stra- 
tegic information courses. More than half of the respon- 
dents who offered training at any time in each content 
area also provided this training in 2012. Courses in nine 
of the fourteen categories were offered in every state and 
the Federal Capital Territory of Abuja. In addition, train- 
ing in infant feeding and nutrition was offered in every 
state except one. The remaining four content areas - be- 
havior change, pediatric HIV/AIDS, leadership, and 
other/IRB - received less coverage. Table 1 highlights 
1ST training categories and state coverage by implement- 
ing partners included in the assessment. 

The respondents reported that training courses tar- 
geted trainers, doctors, nurses, midwives, and commu- 
nity health extension workers (CHEWs) in each training 



Table 1 In-service training (1ST) training categories and 
state coverage by implementing partners 



Training category 


Total number 


Total number 


Total number of 




of IPs who 


of IPs who 


states^ in which 




reported 


reported 


IPs conducted 




providing 


providing 


training since 




training in this 


training in this 


2007 




category since 


category in 






2007 


2012 




PMTCT 


12 


8 


37^ 


Behavior change 


12 


9 


23 


Counseling 


14 


10 


37^ 


and testing 








Infant feeding/ 


4 


3 


36 


nutrition 








Pediatric 


7 


4 


17 


HIV/AIDS 








Care and 


11 


9 


37^ 


treatment 








OVC 


13 


10 


37^ 


Laboratory/ 


13 


9 


37^ 


blood safety 








Supply chain 


5 


4 


37^ 


HIV/family 


1 


1 


37^ 


planning 








HIVm 


10 


7 


37^ 


Strategic 


14 


8 


37^ 


information 








Leadership, 


9 


7 


28 


policy, 








financing 








Other 


1 


1 


10 



^Includes 36 States plus the Federal Capital Territory of Abuja. 

OVC, orphans and vulnerable children; PMTCT, prevention of mother to child 

transmission of HIV. 



category. In addition, they reported training a wide range 
of 'other' health workers which include, but are not 
limited to, the following: laboratory workers, pharma- 
cists, monitoring and evaluation specialists, government 
officials, social workers, community volunteers, case 
managers, nutritionists, and caregivers. Thus, PEPFAR- 
supported 1ST is reaching a diverse range of health 
workers at various levels of the health system. Table 2 
outlines the number of implementing partners who re- 
ported training a particular cadre of health worker in 
each training category. 

Implementing partners were also asked about the total 
number of participants trained by cadre. Some of the re- 
spondents did not have access to disaggregated figures. 
In addition, a review of the data revealed a number of 
inaccuracies. The authors followed up directly with 
implementing partners to better understand the inaccur- 
ate figures. It appears that some implementing partners 
interpreted the question as referring only to professional 
or other formal clinical cadres. Thus, the figures they 
reported did not include the training of government offi- 
cials or other informal health workers, such as community 
volunteers and caregivers. Further, some respondents ap- 
peared to double count participants. Similar challenges 
were noted after a closer inspection of the gender disag- 
gregated figures reported by implementing partners. As a 
result, data about numbers of health workers trained as 
well as the gender distribution of trained health workers 
were deemed to be too unreliable to analyse. 

Collaboration and coordination between implementing 
partners 

Implementing partners were asked to describe how they 
collaborate and coordinate with each other in the planning 
and delivery of training. In ten of the fourteen content 
areas, less than half of the respondents reported collabor- 
ating with another partner to conduct training (see 
Table 3). Laboratory/blood safety training had the highest 
level of reported collaboration. Further context about co- 
ordination among IPs was provided during the stakeholder 
engagement process. Implementing partners that partici- 
pated in the tool development phase gave isolated reports 
of contracting with other partners for services, providing 
training to other partners, and avoiding providing services 
in locations where other partners with similar focuses may 
have already begun working. There were also reports of 
implementing partners working together to harmonize 
1ST curricula and working collaboratively through coord- 
ination meetings and technical working groups. The con- 
sensus among implementing partners appears to be that 
coordination is stronger in areas such as PMTCT and 
blood safety because USAID (through PEPFAR) and other 
development partners have intervened to encourage or re- 
quire coordination among IPs. 
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Table 2 Health worker cadres by training category 



Training category 


Trainers 


Doctors 


Nurses 


Midwives 


Community health 
extension workers 


Other 


PMTCT(n = 12) 


7 


12 


12 


11 


11 


11 


Behavior change (n = 12) 


5 


2 


3 


1 


2 


5 


Counseling and testing (n = 14) 


8 


9 


13 


8 


11 


12 


Infant feeding/ nutrition (n = 4) 


2 


4 


4 


4 


4 


1 


Pediatric HIV/AIDS (n = 7) 


5 


6 


6 


5 


3 


3 


Care and treatment (n = 1 1) 


4 


9 


10 


7 


7 


7 


OVC (n = 13) 


6 


1 


7 


3 


7 


9 


Laboratory/blood safety (n = 13) 


6 


5 


6 


3 


4 


11 


Supply chain (n = 5) 


4 


1 


2 


1 


2 


5 


HIV/family planning (n = 1) 


1 


1 


1 


1 


1 


1 


HIVm (n = 10) 


5 


10 


8 


3 


6 


7 


Strategic information (n = 14) 


7 


6 


7 


4 


6 


12 


Leadership, policy, and financing (n = 9) 


5 


3 


2 


2 


1 


7 


Other (n = l) 


1 


1 


1 


1 


0 


1 



OVC, orphans and vulnerable children; PTMCT, prevention of mother to child transmission of HIV. 



Variety and appropriateness of curricula and training 
approaches used 

Most respondents reported using national curricula, 
guidelines, manuals and/or standard training operating 
procedures to conduct 1ST (see Table 4). A few imple- 
menting partners reported that there was no national 
curriculum for the specific type of training that they 
offer (for example, training related to high risk groups). 
An absence of national curriculum was reported most 
frequently for the content areas of strategic information, 
and leadership, policy and financing. In addition, the sole 
implementing partner that reported providing training 

Table 3 In-service training (1ST) collaboration among 
President's Emergency Plan for AIDS Relief (PEPFAR) 
implementing partners 



Training category 



Total number of IPs who 
reported collaborating with 
another PEPFAR IP to conduct 
training in this category 



PMTCT(n = 12) 


6 


Behavior change (n = 12) 


5 


Counseling and testing (n = 14) 


7 


Infant feeding/nutrition (n = 4) 


2 


Pediatric HIV/AIDS (n = 7) 


2 


Care and treatment (n = 1 1) 


4 


OVC (n = 13) 


5 


Laboratory/blood safety (n = 13) 


10 


Supply chain (n = 5) 


2 


HIV/family planning (n = 1) 


0 



OVC, orphans and vulnerable children; PTMCT, prevention of mother to child 
transmission of HIV. 



in HIV and family planning noted that there was no na- 
tional curriculum for the particular training they offer. 
Few implementing partners reported that they use a cur- 
riculum that is not based on the national curriculum 
when such a curriculum is available. It is of note that 
though a national curriculum may exist for a given con- 
tent area, it may not cover specific sub-topics addressed 
in trainings conducted by IPs. This may have contrib- 
uted to some IPs reporting that a national curriculum 
exists for a content area in which other IPs report there 
being no national curriculum. 

The most common training format reported by the 
implementing partners was face-to-face, group-based 
training, which requires funding for travel and per diem 
(see Table 5). A number of implementing partners also 
reported using on-the-job training as a delivery ap- 
proach. This approach was used by at least one imple- 
menting partner in every content area. E-learning was 
used by very few respondents, and for only half (7) of 
the content areas. Additional training approaches that 
were reported in the 'other' category were: training of 
trainers, facility-based step-down training, supportive 
supervision, mentoring, community-based group train- 
ing, practicum, field visits, and peer mentoring. 

Application of needs assessments and training 
evaluations 

Survey respondents reported using a variety of methods 
to conduct training needs assessments to inform the 
planning, design, and development of their 1ST pro- 
grammes and to identify participants. Further, there were 
only a few instances where no training needs assessment 
was used. Table 6 outlines the prevalence of the various 
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Table 4 Use of national curricula in developing in-service 
training (1ST) 

Training category No Using the Using Using 

national national modified curricula 
curricula curriculum version of that are not 
exist national based on 

curriculum the national 
curriculum 



PMTCT 
(n = 12) 


1 


8 


3 


0 


Behavior change 
(n = 12) 


2 


3 


7 


0 


Counseling 
and testing 
(n = 14) 


0 


12 


2 


0 


Infant feeding/ 
nutrition (n = 4) 


0 


4 


0 


0 


Pediatric HIV/ 
AIDS (n = 7) 


0 


4 


2 


1 


Care and 
treatment 
(n = 11) 


0 


4 


7 


0 


UVL (n = \5) 


1 


6 


6 


0 


Laboratory/ 
blood safety 
(n = 13) 


2 


6 


4 


1 


Supply chain 
(n = 5) 


0 


5 


0 


0 


HIV/family planning 
(n = l) 


1 


0 


0 


0 


HIVm (n = 10) 


0 


5 


5 


0 


Strategic information 
(n = 14) 


4 


5 


5 


0 


Leadership, 
policy, financing 
(n = 9) 


4 


3 


1 


1 


Other (n = l) 


1 


0 


0 


0 



OVC, orphans and vulnerable children; PTMCT, prevention of mother to child 
transmission of HIV. 



types of needs assessments used by content area. The 
most frequently reported approaches were pre-training 
assessments of health workers' knowledge and skills, and 
reviewing existing curricula on the subject matter. 

The survey included several questions related to the 
evaluation of training courses. In eight of the training 
categories, fewer than half of the respondents indicated 
that they have conducted an assessment or evaluation of 
the effectiveness or impact of the training (see Table 7). 
Evaluation appears to happen most frequently for the con- 
tent areas of PMTCT and laboratory/blood safety. Further, 
follow up assessments of health worker performance 
happens more frequently than evaluation of impact. In 
11 categories, at least half of the respondents reported 
having conducted some type of follow up assessment of 
health workers' performance. Few implementing partners 



Table 5 In-service training (1ST) training modalities 



Training category^ 


Face-to-face 
with travel 
and per diem 


On the job 


e-learning Other 


PM ILI (n = 12) 


1 2 


9 


0 1 


Behavior change 
(n = 9) 


9 


5 


1 3 


Counseling and 
testing (n = 14) 


12 


6 


0 1 


Infant feeding/ 
nutrition (n =4) 


4 


3 


0 0 


Pediatric HIV/AIDS 
(n = 7) 


6 


6 


1 1 


Care and treatment 
(n = ll) 


10 


7 


0 2 


OVC (n = 13) 


12 


7 


0 2 


Laboratory/blood 
safety (n = 1 3) 


12 


8 


0 1 


Supply chain 
(n = 5) 


5 


1 


0 0 


HIV/family planning 
(n = l) 


1 


1 


1 0 


HIVm (n = 10) 


9 


7 


2 3 


Strategic information 
(n = 14) 


13 


8 


2 2 


Leadership, policy, 
financing (n = 9) 


7 


2 


1 0 


Other (n = l) 


1 


0 


1 0 



^Participants were able to select more than one answer. 

OVC, orphans and vulnerable children; PTMCT, prevention of mother to child 

transmission of HIV. 



reported that they made changes to their training curric- 
ula based on follow up assessments of health workers. 
However, those that did make changes reported, among 
other things, adding modules or modifying existing mod- 
ules, modifying the course length, improving training 
slides, including more case studies, improving monitor- 
ing and tracking of activities, revising the training modal- 
ity, and providing physical examples of things like drugs 
and tools. 

Integration of 1ST content into pre-service education and 
continuous professional development programs 

Few respondents indicated making any links between their 
training courses and continuing professional development 
(CPD) or pre-service education programmes. Though 
implementing partners frequently offer training partici- 
pants a certificate or credential upon completion of a 
course, it is less common for the 1ST to be recognized by 
a training institution or university or for 1ST to qualify for 
continuing professional development credits from a pro- 
fessional council or lead to promotion or career develop- 
ment within the participants organization/institution (see 
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Table 6 Reported use of training needs assessments 



Training 
category^ 


Did not 
conduct 
TNA 


Reviewed 
health 
service use/ 
outcome 
data 


Reviewed 
hospital 
or clinic 
records 


Reviewed 

existing 

curricula 


Interviews/ 
surveys of 
MOH/ 
licensing 
staff 


Interviews/ 
surveys of 
beneficiaries 


Reviewed 
supervisor/ 
performance 
records 


Observed 
health 
worker 
performance 


Pre-training 
assessment 
of health 
workers 


Other 


PMTCT 






















(n = 12) 


1 


6 


4 


6 


4 


2 


1 


5 


8 


0 


Behavior 
change 
(n = 12) 


2 


1 


0 


4 


0 


6 


0 


2 


6 


3 


Counseling 
and testing 
(n = 14) 


2 


3 


3 


3 


2 


5 


1 


5 


10 


3 


Infant 

feeding/ 

nutrition 






















(n = 4) 


0 


2 


1 


3 


0 


0 


1 


0 


1 


1 


Pediatric 
HIV/AIDS 
(n = 7) 


0 


1 


2 


2 


0 


2 


1 


1 


5 


0 


Care and 
treatment 
(n = ll) 


0 


4 


2 


6 


2 


1 


0 


6 


9 


1 


OVC 
(n = 13) 


3 


2 


0 


1 


2 


2 


1 


1 


6 


2 


Laboratory/ 
blood safety 
(n = 13) 


1 


3 


4 


4 


1 


0 


0 


4 


7 


2 


Supply 
chain 
(n = 5) 


0 


2 


0 


1 


1 


1 


0 


0 


4 


0 


HIV/family 
planning 
(n = l) 


0 


0 


1 


1 


1 


0 


0 


1 


1 


0 


HIVm 
(n = 10) 


0 


3 


2 


5 


2 


2 


2 


2 


6 


1 


Strategic 
information 
(n = 14) 


2 


1 


3 


1 


1 


2 


2 


2 


10 


0 


Leadership, 
policy, 
financing 
(n = 9) 


1 


0 


0 


2 


3 


1 


3 


1 


2 


1 


Other 
(n = l) 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 



^Note: survey respondents were able to select more than one answer. 

OVC, orphans and vulnerable children; PTMCT, prevention of mother to child transmission of HIV. 



Table 8). Coordination between implementing partners 
and professional councils that accredit CPD remain at a 
very early stage. Content areas that were reported as hav- 
ing been recognized by a training institution or university 
were: PMTCT; care and treatment; and leadership, policy, 
and financing. Similarly, content areas for which CPD 
credits were reportedly offered were: PMTCT; counseling 
and testing; care and treatment; and leadership, policy, 
and financing. 



Planning for the continued financial support and capacity 
for 1ST programs 

The survey asked implementing partners to describe what 
they have done to ensure that financial support will be 
available for the 1ST they provide to continue providing 
the training after their PEPFAR funding obligations end. 
Likewise, respondents were also asked to comment on sus- 
tainability plans for human resources and organizational 
capacity. The majority of respondents reported taking 
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Table 7 Reported evaluation of In-service training (1ST) 



Training category Have you Have you 

conducted any implemented 

assessment or any follow-up 

evaluation of assessment that 
the effectiveness investigated whether/ 
or impact of this how health worker 

training in performance has 

Nigeria? (yes) changed? (yes) 

PMTCT(n = 12) 8 8 

Behavior change (n = 12) 3 5 

Counseling and testing 6 9 
(n = 14) 

Infant feeding/nutrition 

(n = 4) 1 2 

Pediatric HIV/AIDS (n = 7) 3 6 

Care and treatment 5 9 

(n = ll) 

0VC(n = 13) 5 7 

Laboratory/blood safety 8 9 
(n = 13) 

Supply chain (n = 5) 3 3 

HIV/family planning (n = 1) 0 0 

HIVm(n = 10) 6 5 

Strategic information 7 9 

(n = 14) 

Leadership, policy, 4 4 

financing (n = 9) 

Other (n = l) 1 0 



OVC, orphans and vulnerable children; PTMCT, prevention of mother to child 
transmission of HIV. 

some action to ensure the financial sustainability of their 
training. However, a number of implementing partners 
reported that they had not as yet done anything (see 
Table 9). Funding from the federal government has been 
secured for two categories of training: laboratory/blood 
safety, and leadership, policy and financing. State and 
local government funding has been secured for four cat- 
egories: PMTCT; counseling and testing; OVC; and la- 
boratory/blood safety. 

Similarly, although the majority of respondents re- 
ported taking some action to ensure that human re- 
sources and organizational capacity are available to help 
sustain training after PEPFAR funding expires, several 
indicated that they have done nothing yet (see Table 10). 
It is of note that training in four categories (counseling 
and testing, OVC, laboratory/blood safety, and strategic 
information) has been embedded into CPD modules 
accredited by a professional licensing board, and that 
some of the training in two categories (supply chain; 
leadership, policy, and financing) has been incorporated 
into a pre-service curriculum. 

A number of implementing partners indicated that they 
are doing other' things to ensure financial sustainability 



Table 8 Reported accreditation of in-service training (1ST) 

Training Do graduates Is the course Do graduates 

category receive a recognized by receive CPD 

certificate or a training credits that 
credential? institution? are accredited by 

a professional 
council? 



PMTCT (n = 1 2) 


1 1 


] 


3 


Behavior change 

{w — 1 z; 


10 


0 


0 


Counseling and 

tp«;tinn (n — ^A) 


14 


0 


1 


Infpint fppHinn/ 
1 1 1 1 ci 1 1 L 1 ecu 1 1 ly/ 

nutrition (n =4) 


] 




gb 


Pediatric HIV/AIDS 

fn - 7) 
\\ \ — / ) 


6 


0 


0 


Care and 

trp;^tnnpnt fn = 1 11 

LI^CILI 1 Id 1 L \^l 1 — 1 \ J 


10 


1 


1 


OVC (n = 1 3) 


9 


0 


0 


Laboratory/blood 
safety (n = 1 3) 


13 


0 


0 


Supply chain 
(n = 5) 


4 


0 


0 


HIV/family 
planning (n = 1) 


1 


0 


0 


HIVm (n = 10) 


9 


0 


0 


Strategic 
information 
(n = 14) 


9 


0 


0 


Leadership, policy, 
financing (n = 9) 


6 


2 


1 


Other (n = l) 


1 


0 


0 



^One implementing partner did not answer the question. 

"^One Implementing partner did not answer the question. 

OVC, orphans and vulnerable children; PTMCT, prevention of mother to child 

transmission of HIV. 



and continued capacity for training after PEPFAR fund- 
ing expires. Advocacy to the State Ministry of Health 
(SMOH) and Federal Ministry of Health (FMOH) for a 
budgetary allocation was frequently mentioned as well as 
consistently involving the SMOH and FMOH in training 
to emphasize the need for continued government fund- 
ing. Respondents also reported that they are generating 
financial resources through grants submitted by im- 
plementing partners and other community-based organi- 
zations, by developing mechanisms to charge fees for 
courses, by developing relationships with other organi- 
zations that can also raise funds for training, and by 
leveraging other funds. They also reported training gov- 
ernment officials, community-based organizations, non- 
governmental organizations, master trainers, health 
workers and facility-based staff to step down training 
once PEPFAR funding ends. In addition, the responsibil- 
ity for providing 1ST has been or will be transitioned to 
other implementing partners, civil society organizations. 
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Table 9 Financial sustainability planning for in-service training (1ST) 



Training category Nothing yet Federal State or local 

government government 
funding secured funding secured 



Multilateral donor Bilateral donor Private donor Other 
funding secured funding secured funding secured 



PMTCT 

(n = 12) 

Behavior 
change (n = 12) 

Counseling and 
testing (n = 14) 

Infant feeding/ 
nutrition 

(n = 4)' 

Pediatric HIV/AIDS 
(n = 7) 

Care and 

treatment (n = 1 1) 

OVC (n = 13) 

Laboratory/blood 
safety (n = 1 3) 

Supply chain 
(n = 5) 

HIV/family 
planning (n = 1) 

HIVm (n = 10) 

Strategic 
information 
(n = 14) 

Leadership, policy, 
financing (n = 9) 

Other (n = l) 



^Two implementing partners did not answer this question. 

OVC, orphans and vulnerable children; PTMCT, prevention of mother to child transmission of HIV. 



training institutions, and other groups that can sustain 
the training. 

The use of information systems to collect and manage 
1ST data 

Most respondents reported using a combination of paper 
and computer (for example, Excel spreadsheets) -based ap- 
proaches to capture data on their training courses. How- 
ever, a few implementing partners reported using only 
paper-based files, and others reported using more sophis- 
ticated, customized databases. For example, one imple- 
menting partner reported that their organization uses an 
automated training database that allows them to track 
trainees over time. Thirty-one of the 39 respondents said 
that they are experiencing challenges in managing and 
using 1ST data, such as a lack of capacity to collect and 
analyse data as well as to follow up with trainees after 
training. The survey also asked partners to consider the 
potential benefits and challenges of reporting into a stan- 
dardized training information management system. The 
respondents noted that in order to be effective the system 



must be jointly developed between PEPFAR and imple- 
menting partners. They perceived that such a system 
would have several advantages including setting a mini- 
mum standard for documenting training, promoting col- 
laboration among implementing partners by highlighting 
areas of possible joint planning or joint implementation, 
and reducing duplication of effort. Disadvantages included 
increasing workloads, the cost associated with training 
staff on how to use the system, and difficulty customizing 
data collection (for example, documenting what happens 
in non-workshop-based training). 

Conclusions and recommendations 

PEPFAR implementing partners are already providing 1ST 
in Nigeria which is aligned with several recommendations 
from the 1ST Improvement Framework. For example, 
most implementing partners reported aligning their 1ST 
with national curricula and standards. The capacity of 
local trainers is being developed through training of 
trainers. And, implementing partners are conducting 
training needs assessment to design and plan courses. 
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Table 10 Sustainability - human resources and organizational capacity 



Training category Nothing yet A public- sector A private- sector A local partner Embedded into Embedded into Other 

entity entity organization a CPD module pre-service curricula 

PMTCT 

(n = 12) 4 1 0 5 0 0 2 

Behavior change 3 3 0 3 0 0 3 

(n = 12) 

Counseling and 2 2 0 4 10 5 

testing (n = 14) 

Infant feeding/nutrition 

(n = 4f 0 0 0 2 0 0 0 

Pediatric HIV/AIDS 4 0 0 2 0 0 1 

(n = 7) 

Care and treatment 4 1 0 2 0 0 4 

(n = 11) 

0VC(n = 13) 2 2 0 3 2 0 4 

Laboratory/blood 3 4 2 0 10 3 

safety (n = 1 3) 

Supply chain (n = 5) 0 0 1 0 0 1 3 

HIV/family planning 0 0 0 0 0 0 1 

(n = 1) 

HIVm(n = 10) 3 0 1 2 0 0 4 

Strategic information 8 11 0 10 3 

(n = 14) 

Leadership, policy, 3 11 0 0 1 3 

financing (n = 9) 

Other (n = 1) 0 10 0 0 0 0 

^Two implementing partners did not answer this question. 

OVC, orphans and vulnerable children; PTMCT, prevention of mother to child transmission of HIV. 



A comparison of the results of the survey in relation 
to the recommendations of the 1ST Improvement 
Framework points to six priority suggestions for improv- 
ing the efficiency, effectiveness and sustainability of 
PEPFAR-funded 1ST in Nigeria. These recommendations 
are discussed below. 

Increase coordination and collaboration among 
implementing partners 

Coordination and collaboration are particularly import- 
ant when two or more implementing partners offer 
training on the same content, target the same cadre, 
and/or provide training in the same state. Few survey re- 
spondents reported that they were collaborating with 
other PEPFAR-funded implementing partners to plan 
and conduct 1ST. However, in many cases, there ap- 
peared to be overlap in the work that implementing 
partners are doing. For example, most implementing 
partners reported using the national curriculum for their 
training and within each of the training categories mul- 
tiple implementing partners reported targeting the same 
health worker cadres. In addition, for some training cat- 
egories, multiple partners reported offering the same 



category of 1ST within the same state. There is a need to 
identify opportunities for collaboration between partners 
in order to use resources more efficiently, reduce dupli- 
cation of effort, and harmonize training strategies. 

Use a more diverse and cost-effective set of 
training modalities to decrease the unit cost of 
training as well as the amount of time workers 
spend away from their facilities 

Face-to-face, group-based training with travel and other 
related costs is by far the most common approach re- 
ported for the delivery of 1ST. Several implementing 
partners also reported using on-the-job training as a 
course delivery modality, and very few reported using 
e-learning or other self-directed or distance learning ap- 
proaches. Embracing alternative and innovative training 
modalities has the potential to reduce costs and to in- 
crease the number of health workers that have access to 
training. On-the-job and distance learning approaches 
will also help to minimize disruption of services and im- 
prove the transfer and application of learning to the 
workplace. 
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Allocate funding specifically for follow up with 
health workers after training to support the 
transfer and application of learning and the 
evaluation of the effectiveness of training 

Despite the large investments made in the training of 
health workers in Nigeria, little is known about the ef- 
fectiveness of this training. Few survey respondents re- 
ported that they are evaluating their training. This is a 
lost opportunity to assess the impact of the training on 
health worker performance and service delivery out- 
comes as well as to provide post-training support and 
feedback to trainees, to support the transfer and applica- 
tion of learning and identif)^ further training needs. Re- 
spondents to the survey noted that one of the biggest 
obstacles to evaluating training is lack of funding for the 
costs of such follow up. It is, therefore, suggested to ear- 
mark a portion of 1ST funding for evaluating the effect- 
iveness and impact of the training, including an analysis 
of the unit cost per trainee. This has the potential to 
demonstrate the extent to which the training has im- 
proved the quality of the HIV/ AIDS related services 
delivered and its impact on the overall HIV/ AIDS situ- 
ation. It will also add to the understanding of best prac- 
tices in training health workers, to improve the quality 
and relevance of the training provided, and to increase 
the effectiveness of PEPFAR-funded training. 

Ensure broader access to new developments in 
knowledge and technology, as well as 
sustainability of training, by integrating 1ST 
content into pre-service education curricula and 
continuing professional development (CPD) 
programs 

Many survey respondents reported offering trainees a 
certificate or credential after completing training 
courses. However, very few reported that their courses 
are recognized by a training institution or provide con- 
tinuing professional development credits recognized by a 
professional health council. In addition, few implement- 
ing partners reported that their 1ST is embedded in a 
CPD module or in a pre-service curriculum. Strengthen- 
ing links between 1ST and pre-service education as well 
as between 1ST and CPD has the potential to promote 
sustainability, consistency in learning approaches and 
content between PSE and 1ST and to improve access to 
training. Using tutors from local training institutions 
and building their capacity to train could potentially im- 
prove the quality of PSE and 1ST provided. In addition, 
being associated with a training institution or health 
professional council encourages participation, may in- 
crease sustainability if trainees are required to pay a 
nominal fee, raises the visibility of the training, and adds 
a degree of credibility. 



Create sustainability plans to ensure that financial 
resources, human resources, and organizational 
capacity are available to support 1ST after PEPFAR 
funding expires 

Many survey respondents reported taking steps to en- 
sure that their training is sustained after PEPFAR fund- 
ing expires. For example, master trainers are being 
trained in every training category, other funding sources 
are being secured, and public-sector, private-sector and 
local organizations are being enabled to take over train- 
ing. Implementing partners are encouraged to advocate 
to the government for a line-item budget for HIV/ AIDS 
related 1ST and strengthening local resources such as 
trainers. Beyond this, the content and resources devel- 
oped for the training can be further sustained and 
strengthened through continued skills transfer, the use 
of master trainers, and the adaptation and integration of 
1ST content and resources within existing curricula and 
related training programmes. It is critical to strengthen 
health training institutions and systems to improve cost- 
effectiveness, sustainability and accessibility of 1ST. 

Design an 1ST information system as a mechanism 
to support improved planning, coordination, 
tracking and reporting of PEPFAR-funded 1ST 

Data from the online survey indicate that implementing 
partners perceive a number of benefits to developing a 
common 1ST information system that all implementing 
partners would report into. However, they note it is im- 
portant that such a system be designed in collaboration 
with implementing partners to ensure that it meets their 
specific needs and to ensure ease of use. Importantly, 
implementing partners report they believe that a central- 
ized system will promote a more systematic approach to 
coordination, encourage collaboration, reduce duplica- 
tion of effort, and potentially increase the effectiveness 
of training by providing access to national training 
process and outcome data. As previously discussed, co- 
ordination of 1ST is essential for efficient and effective 
training. In order to coordinate the planning, execution 
and follow up of 1ST, strong data management systems 
are needed to provide implementing partners with the 
tools they need. 

Additional file 



Additional file 1: In-Service Training Survey of PEPFAR-funded 
implementing partners. 
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